Underestimate Sequences via Quadratic Averaging

نویسندگان

  • Chenxin Ma
  • Naga Venkata C. Gudapati
  • Majid Jahani
  • Rachael Tappenden
  • Martin Takác
چکیده

In this work we introduce the concept of an Underestimate Sequence (UES), which is a natural extension of Nesterov’s estimate sequence [16]. Our definition of a UES utilizes three sequences, one of which is a lower bound (or under-estimator) of the objective function. The question of how to construct an appropriate sequence of lower bounds is also addressed, and we present lower bounds for strongly convex smooth functions and for strongly convex composite functions, which adhere to the UES framework. Further, we propose several first order methods for minimizing strongly convex functions in both the smooth and composite cases. The algorithms, based on efficiently updating lower bounds on the objective functions, have natural stopping conditions, which provides the user with a certificate of optimality. Convergence of all algorithms is guaranteed through the UES framework, and we show that all presented algorithms converge linearly, with the accelerated variants enjoying the optimal linear rate of convergence.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Accountability of Modern Adiabatic Connection-Based Double-Hybrids Constructed from Cubic and Quadratic Integrand Functions for Dipole Polarizabilities of Water Nanoclusters

In this work, we dissect the performance of  two modern Perdew-Burke-Ernzerhof (PBE)-based double-hybrid (DH) density functionals to predict the isotropic and anisotropic polarizabilities of water nanoclusters (H2O)n [n = 2-6]. The considered models include the cubic integrand (CI) and quadratic integrand (QI) functions as well as the spin-opposite-scaled...

متن کامل

Selecting Weighting Factors in Logarithmic Opinion Pools

A simple linear averaging of the outputs of several networks as e.g. in bagging 3], seems to follow naturally from a bias/variance decomposition of the sum-squared error. The sum-squared error of the average model is a quadratic function of the weighting factors assigned to the networks in the ensemble 7], suggesting a quadratic programmingalgorithm for nding the \optimal"weighting factors. If ...

متن کامل

A mathematically simple method based on denition for computing eigenvalues, generalized eigenvalues and quadratic eigenvalues of matrices

In this paper, a fundamentally new method, based on the denition, is introduced for numerical computation of eigenvalues, generalized eigenvalues and quadratic eigenvalues of matrices. Some examples are provided to show the accuracy and reliability of the proposed method. It is shown that the proposed method gives other sequences than that of existing methods but they still are convergent to th...

متن کامل

Instrument Selection by First Stage Prediction Averaging∗

This paper considers model averaging as a way to select instruments for the two stage least squares and limited information maximum likelihood estimators in the presence of many instruments. We propose averaging across least squares predictions of the endogenous variables obtained from many different choices of instruments and then use the average predicted value of the endogenous variables in ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • CoRR

دوره abs/1710.03695  شماره 

صفحات  -

تاریخ انتشار 2017